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SYSTEM USING MULTIPLE DISPLAY SCREENS FOR MULTIPLE 

VIDEO STREAMS 

BACKGROUND OF THE INVENTION 
[0001] This invention relates in general to playback of a visual production and more 

specifically to using multiple display screens to display multiple video streams. 
[0002] Enjoyment of digital content is growing in popularity. Video and movies can 

be viewed from platforms such as computer systems, consumer digital devices such as video 
compact disc (CD), DVD players, and other displays, systems or platforms. Other formats, 
such as those promulgated by the Motion Picture Expert Group (MPEG) allow stored or 
streamed visual productions over digital networks. 

[0003] Recent advances in display technology allow picture-in-picture displays of 

two or more video streams, or channels, on a single display device. A user, or viewer, of a 
television can select a primary channel and can also view other, secondary, channels in 
smaller windows on the single screen. 

[0004] Multiple streams of video information obtained from stored media such as 

DVDs can also be displayed simultaneously. For example, U.S. Patent No. 6,415,101 
describes a video decoding system for retrieving multiple views from a DVD content source. 
The views can then be selectively displayed as primary and secondary views. The secondary 
views are displayed within sub-windows in the primary view. 

[0005] Although these approaches allow enhancement of a user's viewing experience 

by simultaneously presenting multiple views of video, the approaches are limited in 
usefulness. Therefore it is desirable to provide improvements to the prior art to enhance and 
expand upon content viewing for entertainment, education, efficient presentation of 
information and other purposes. 


BRIEF SUMMARY OF THE INVENTION 
[0006] A preferred embodiment of the present invention allows multiple video 

streams, or other image information, to be selectively directed among two or more display 
screens. The video streams can be directed automatically, manually or by a combination of 
automated and manual techniques. This allows multiple video streams to be viewed 
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simultaneously on different display screens to, e.g., increase the viewing area, provide 
selectable enhancement and control of video viewing. 

[0007] In one embodiment the invention provides a method for directing two or more 

image streams to two or more display devices, the method comprising detecting a first video 
stream and associated first stream identification; detecting a second video stream and 
associated second stream identification; detecting a first display device and associated first 
display device identification; detecting a second display device and associated second display 
device identification; and directing the video streams to the display devices by using the 
identifications. 

[0008] In another embodiment the invention provides a stream director for directing 

two or more image streams to two or more display devices, the method comprising a first 
input for a first video stream and associated first stream identification; a second input for a 
second video stream and associated second stream identification; a first output for a first 
display device and associated first display device identification; a second output for a second 
display device and associated second display device identification; and means for directing 
the video streams to the display devices by using the identifications. 


BRIEF DESCRIPTION OF THE DRAWINGS 
[0009] Fig. 1 is a block diagram of a preferred embodiment of the invention; and 

[0010] Fig. 2 illustrates a panoramic video feature of the invention. 

DETAILED DESCRIPTION OF THE INVENTION 
[0011] Fig. 1 is a diagram showing the basic approach of the invention. 

[0012] In Fig. 1, image information source 102 provides content such as broadcast or 


pre-stored digital video data. Multiple streams are derived from the video data by retrieval 
hardware 104. The multiple streams are shown as "Stream 1," "Stream 2," . . . "Stream n" in 
Fig. 1. Naturally, any number and type of streams can be used. Different applications may 
used different types of streams, such as broadcast "channels," hardwired "feeds," etc. A 
preferred embodiment also includes auxiliary information with the streams. The auxiliary 
information can be included with the same carrier as the video stream information (e.g., 
embedded with the video signal) or it can be provided as a distinct signal, or any other 
suitable approach may be used. One possibility is to use standard "sub : picture" information 
to carry auxiliary data about an associated stream. 
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[0013] The stream and auxiliary data are provided to stream director 108. Stream 

director 108 directs the input streams among two or more display devices 130. The directed 
streams at 120 do not have to correspond to the arrangement or number of the input streams 
at 106. In other words, streams can be directed to display devices arbitrarily and 
dynamically. Also, it is not necessary to direct all streams. Some streams can be selectively 
suppressed. A single stream can be sent to multiple devices. Streams can be combined into 
a single display device. Other variations may be possible. 

[0014] Other possible sources for auxiliary, or other, signals include control source 

1 10 and user input device 1 12. Control source 1 10 can be an external device or an 
information source such as a local network, the Internet, etc. A preferred embodiment uses a 
typical television remote control as a user input device and can allow a user to select streams 
for viewing or allow directing a specific stream to a specific display device. Combinations of 
automated and manual (i.e., user controlled) stream direction can be used. 
[0015] For example, the auxiliary information associated with a stream can describe 

what type of camera angle or view of a scene is contained within the stream. This allows a 
multi-screen "expanded" panoramic display (or "panoramic video") to be created by 
assigning multiple streams to their respectively positioned display devices. For example, 
three screens can be used in a "left," "center" and "right" arrangement as is known in the art. 
Then, left, center and right video streams can automatically be steered to their respective 
displays. 

[0016] Such a panoramic video arrangement is shown in Fig. 2. 

[0017] In Fig. 2, system 200 is a portion of the system 100 of Fig. 1. System 200 

includes stream director 202 that can be controlled by the means discussed, above, for Fig. 1 . 
Three streams "Stream 1," "Stream 2" and "Stream 3" are detected and, using associated 
auxiliary information, directed to appropriate display devices "A," "B" and "C" positioned as 
left, center and right displays, respectively. Display device positioning can be communicated 
to stream director 202 by any suitable means. For example, hardwired connectors on a 
physical enclosure housing stream director 202 can be pre-assigned with left, center and right 
display outputs. Or a user can manually configure connections for different displays. 
Displays and their positions can be detected automatically. Other approaches can be used. 
[0018] Note that any number and position of display devices can be used. Also, 

display devices can be any aspect ratio or shape. Display devices can also be any suitable 
type such as liquid crystal display (LCD), cathode ray tube (CRT), organic light-emitting 
polymer (OLEP), plasma display, etc. 


[0019] Stream information can come from multiple content sources. For example, 

data from the Internet can be used to comprise a stream. Such data can, itself, be video (e.g., 
MPEG-4 format), can be computer generated images, text, web page information, etc. This 
allows a user to specially configure a viewing environment. In a first example, a user can use 
three screens to view a music video. A first screen can display a specific band member of the 
music video, a second screen can display an overall stage view of a performance and a third 
screen can display a close up of a musician's hands playing an instrument. In a second 
example, a user can use 5 screen to view a sporting event. Three screens can be set up as left, 
center, right displays for panoramic video, a fourth screen can be designated to display a 
particular player who is recorded with a dedicated camera and video stream, and the fifth 
screen can display a team's performance statistics as obtained from the Internet. 
[0020] Although the invention has been described with reference to specific 

embodiments thereof, these embodiments are merely illustrative, and not restrictive, of the 
invention. For example, although the invention is discussed primarily with respect to digital 
video, any type of image information format can be employed, including analog formats. 
Although a preferred embodiment contemplates obtaining streams from a DVD, any source 
of information can be used including any type of video player, television set (TV) set-top box 
(e.g., cable/TV/Satellite), etc. Various digital transmission systems, formats; encoding, 
encryption or compression approaches; etc., may be used with the present invention. 
[0021] Any suitable programming language can be used to implement the routines of 

the present invention including C, C++, Java, assembly language, etc. Different 
programming techniques can be employed such as procedural or object oriented. The 
routines can execute on a single processing device or multiple processors. Although the 
steps, operations or computations may be presented in a specific order, this order may be 
changed in different embodiments. In some embodiments, multiple steps shown as sequential 
in this specification can be performed at the same time. The sequence of operations 
described herein can be interrupted, suspended, or otherwise controlled by another process, 
such as an operating system, kernel, etc. The routines can operate in an operating system 
environment or as stand-alone routines occupying all, or a substantial part, of the system 
processing. 

[0022] In the description herein, numerous specific details are provided, such as 

examples of components and/or methods, to provide a thorough understanding of 
embodiments of the present invention. One skilled in the relevant art will recognize, 
however, that an embodiment of the invention can be practiced without one or more of the 
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specific details, or with other apparatus, systems, assemblies, methods, components, 
materials, parts, and/or the like. In other instances, well-known structures, materials, or 
operations are not specifically shown or described in detail to avoid obscuring aspects of 
embodiments of the present invention. 

[0023] A "computer-readable medium" for purposes of embodiments of the present 

invention may be any medium that can contain, store, communicate, propagate, or transport 
the program for use by or in connection with the instruction execution system, apparatus, 
system or device. The computer readable medium can be, by way of example only but not by 
limitation, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor 
system, apparatus, system, device, propagation medium, or computer memory. 
[0024] A "processor" or "process" includes any human, hardware and/or software 

system, mechanism or component that processes data, signals or other information. A 
processor can include a system with a general-purpose central processing unit, multiple 
processing units, dedicated circuitry for achieving functionality, or other systems. Processing 
need not be limited to a geographic location, or have temporal limitations. For example, a 
processor can perform its functions in "real time," "offline," in a "batch mode," etc. Portions 
of processing can be performed at different times and at different locations, by different (or 
the same) processing systems. 

[0025] Reference throughout this specification to "one embodiment", "an 

embodiment", or "a specific embodiment" means that a particular feature, structure, or 
characteristic described in connection with the embodiment is included in at least one 
embodiment of the present invention and not necessarily in all embodiments. Thus, 
respective appearances of the phrases "in one embodiment", "in an embodiment", or "in a 
specific embodiment" in various places throughout this specification are not necessarily 
referring to the same embodiment. Furthermore, the particular features, structures, or 
characteristics of any specific embodiment of the present invention may be combined in any 
suitable manner with one or more other embodiments. It is to be understood that other 
variations and modifications of the embodiments of the present invention described and 
illustrated herein are possible in light of the teachings herein and are to be considered as part 
of the spirit and scope of the present invention. 

[0026] Embodiments of the invention may be implemented by using a programmed 

general purpose digital computer, by using application specific integrated circuits, - 
programmable logic devices, field programmable gate arrays, optical, chemical, biological, 
quantum or nanoengineered systems, components and mechanisms may be used. In general, 


the functions of the present invention can be achieved by any means as is known in the art. 
Distributed, or networked systems, components and circuits can be used. Communication, or 
transfer, of data may be wired, wireless, or by any other means. 

[0027] It will also be appreciated that one or more of the elements depicted in the 

drawings/figures can also be implemented in a more separated or integrated manner, or even 
removed or rendered as inoperable in certain cases, as is useful in accordance with a 
particular application. It is also within the spirit and scope of the present invention to 
implement a program or code that can be stored in a machine-readable medium to permit a 
computer to perform any of the methods described above. 

[0028] Additionally, any signal arrows in the drawings/Figures should be considered 

only as exemplary, and not limiting, unless otherwise specifically noted. Furthermore, the 
term "or" as used herein is generally intended to mean "and/or" unless otherwise indicated. 
Combinations of components or steps will also be considered as being noted, where 
terminology is foreseen as rendering the ability to separate or combine is unclear. 
[0029] As used in the description herein and throughout the claims that follow, "a", 

"an", and "the" includes plural references unless the context clearly dictates otherwise. 
Also^ as used in the description herein and throughout the claims that follow, the meaning of 
"in" includes "in" and "on" unless the context clearly dictates otherwise. 
[0030] The foregoing description of illustrated embodiments of the present invention, 

including what is described in the Abstract, is not intended to be exhaustive or to limit the 
invention to the precise forms disclosed herein. While specific embodiments of, and 
examples for, the invention are described herein for illustrative purposes only, various 
equivalent modifications are possible within the spirit and scope of the present invention, as 
those skilled in the relevant art will recognize and appreciate. As indicated, these 
modifications may be made to the present invention in light of the foregoing description of 
illustrated embodiments of the present invention and are to be included within the spirit and 
scope of the present invention. 

[0031] Thus, while the present invention has been described herein with reference to 

particular embodiments thereof, a latitude of modification, various changes and substitutions 
are intended in the foregoing disclosures, and it will be appreciated that in some instances 
some features of embodiments of the invention will be employed without a corresponding use 
of other features without departing from the scope and spirit of the invention as set forth. 
Therefore, many modifications may be made to adapt a particular situation or material to the 
essential scope and spirit of the present invention. It is intended that the invention not be 
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limited to the particular terms used in following claims and/or to the particular embodiment 
disclosed as the best mode contemplated for carrying out this invention, but that the invention 
will include any and all embodiments and equivalents falling within the scope of the 
appended claims. — • 

[0032] Thus, the scope of the invention is to be determined solely by the appended 

claims. 
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